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Preliminary  Investigation  Of 

A  Calculus  of  Functional  Differences: 

Fixed  Differences 


B.  J.  MacLennan 

Computer  Science  Department 

Naval  Postgraduate  School 

Monterey,  CA  93943 


Abstract 


We  introduce  a  notion  of  functional  differences  in  which  the  difference  of  a  function  /  with  respect  to  a 
function  h  is  that  function  g  that  describes  how  the  value  of  /  changes  when  its  argument  is  altered  by  h: 
f(h  x)  =  g(f  x).  We  also  introduce  the  inverse  operation  of  functional  integration  and  derive  useful  pro- 
perties of  both  operations.  The  result  is  a  calculus  that  facilitates  derivation  and  reasoning  about  recursive 
programs.  This  is  illustrated  in  a  number  of  simple  examples.  The  present  report  presents  preliminary 
results  pertaining  to  fixed  differences,  that  is,  functional  differences  that  do  not  depend  on  the  value  of  the 
argument  x. 


1.    Motivation 

Simple  recursive  definitions  often  take  the  following  form: 

/  *o   =    yo 
/  (h  x)    =    g  (f  x),  for  x^xQ 

The  assumption  here  is  that  an  arbitrary  domain  value  x  can  be  reached  by  finitely  many  applications  of 
h.  That  is,  for  all  acceptable  x  there  is  an  n  such  that  x  =  hn  x0.  More  general  patterns  of  recursive 
definition  will  be  considered  later. 

In  deriving  a  recursive  definition  for  a  particular  /,  there  are  four  unknowns  that  must  be  found,  g,  A, 
x0  and  t/0.  Since  h  and  z0  are  usually  determined  by  the  domain  in  question  (e.g.,  they  are  zero  and  the 
successor  function  for  the  domain  of  natural  numbers),  and  y0  is  usually  easily  determined  from  the 
definition  of  /,  the  main  problem  is  determining  the  function  g. 

To  see  how  this  can  be  done  consider  the  second  equation  above: 

f(hx)    =    g(fx) 

The  function  g  tells  us  how  much  the  value  of  the  function  /  changes  when  its  argument  is  changed  by  h. 
That  is,  if  /'s  argument  is  changed  by  h,  then  its  value  is  changed  by  g.    This  equation  is  analogous  to  the 


finite  difference  equation 

f(h  +  x)    =    g  +  (fz) 

The  difference  is  that  in  the  first  equation  the  "amounts  of  change"  are  expressed  as  functions  rather  than 
numbers,  as  they  are  in  the  finite  difference  equation.  This  is  because  we  want  to  be  able  to  deal  with 
functions  whose  domains  and  ranges  are  nonnumeric  (e.g.,  lists,  sets,  relations). 

Based  on  this  analogy  we  introduce 

Definition   1:     We  define   g  to  be  the  functional  difference  of  /  with  respect  to  h  if  and  only  if  it 
satisfies 

f(hx)    =    g(fx). 

We  also  call  g  "the  change  in  /  with  respect  to  A"  or  "the  change  in  /  given  the  change  h." 

The  next  several  sections  will  investigate  the  properties  of  functional  differences1. 

The  above  equation  defines  the  functional  difference  implicitly;  to  get  an  explicit  definition  we  need  to 
solve  it  for  g.    Therefore,  eliminate  x  by  use  of  the  composition  operation: 

/  •   h    =    g  -  f 

This  can  be  solved  by  composing  the  inverse  of  /,  f~  ,  on  both  sides  of  the  equation  to  yield: 

g    =    f  •   h  •   /"• 

This  seems  to  yield  an  explicit  formula  for  the  functional  difference,  but  it  is  necessary  to  be  more  careful. 
First,  /_1  will  not  be  a  function  unless  /  is  an  isomorphism  (one-to-one).  Therefore  we  will  assume  this  for 
the  time  being.  Second,  /  •  f~l  is  not  the  total  identity  function;  rather,  it  is  Irng/i  the  identity  function 
restricted  to  the  range  of  /.    Hence,  doing  the  derivation  more  carefully,  we  have: 

g-  f  =  /  •  h 

g  •  f  •  r1  =  /  •  h .  r1 

g  •  Irng/    =    /  •   h-  /"• 
Therefore,  any  solution  to  the  difference  equation,  when  restricted  to  rng  /,  will  be  /  °  h  °  /_1.    This  is 


1.     A  different  notion  of  functional  differences  is  described  in  [Paige&Koenig82|. 
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summarized  in 

Theorem    1:     Let    /    be    a   one-to-one    function.     If   there    is    a    relation    g    satisfying    the    equation 
/  •  h    =    g  •  /,  then  g  °  L^  f    =    /  ■  h  >  f~l 

Proof:   Presented  above.     Q 

Thus  f  °   h  °   f~l  is  a  subfunction  of  every  solution  to  the  difference  equation.    Note  that  this  theorem 
does  not  say  that  f  °   h  °  f~l  is  itself  a  solution.    This  result  is  proved  in 

Theorem  2:    Let  /  be  a  one-to-one  function.    If  the  functional  equation  /  °  h    =    g  °  f  has  a  solution, 
then  f  °   h  °  f~l  is  a  solution. 

Proof:    For  convenience  we  represent  composition  by  juxtaposition  when  no  ambiguity  will  result.    By 
hypothesis  the  difference  equation  has  a  solution,  so  let  a  solution  g  be  chosen;  we  must  show  that 

fh    =    [fhf'X)f 
We  simplify  the  right  hand  side  as  follows: 

(fhf-l)f    =    Mr  J)    =    M.-/ 

Since  fh  =  gf  we  know  dom  fh  =  dom  gf.  But  dom  gf  C  dom  /  for  all  compositions,  so 
dom  fh  C  dom  /.  From  this  it  follows  that  restricting  the  domain  of  fh  to  dom  /  is  in  fact  no  restriction, 
so  we  have  fhIdom  j    =    fh  and  the  corollary  is  proved.     □ 

This  result  permits  us  to  call  fhf~x  the  minimum  solution  of  the  difference  equation.  In  the  future,  when 
we  speak  of  the  functional  difference  of  /  with  respect  to  h,  we  will  mean  the  minimum  solution  g  of 
fh    =    gf.  which  is  fhf~l . 

Note  however  that  fhf~l  being  a  solution  is  contingent  upon  the  existence  of  some  solution  to  the  equa- 
tion.   The  conditions  for  a  solution  existing  are  stated  in 

Theorem  3:    Let  /  be  a  one-to-one  function.    The  difference  equation  f  °   h    =    g  °  f  has  a  solution  if 
and  only  if  dom  (/  ■    h)    C    dom  /. 

Proof:    To  show   the  "if"  part  we  assume  dom  fh    C    dom  /.     Then,  substituting  fhf      for  g  in   the 
difference  equation  we  have  (as  in  the  proof  of  Thm.  2): 

-3- 


(M-1)/  =  Mr1/)  =  fihomf  =  fh 

The  rightmost  equality  follows  from  the  assumption. 

To  show  the  "only  if"  part  we  assume  that  fh  —  gf  has  a  solution.  Then,  as  in  the  proof  of  Cor.  1-1, 
we  have 

dom  fh    =    dom  gf    C    dom  / 

Hence  dom  fh    C    dom  /.     □ 

We  observe  in  passing  that  none  of  the  preceding  results  depend  on  h  being  one-to-one,  or  even  a  func- 
tion. Indeed,  they  apply  to  any  relation  h.  This  leads  us  to  investigate,  in  the  next  section,  the  isomorphic 
images  of  relations. 

2.    Isomorphic  Images 

In  [MacLennan83]  we  define  the  isomorphic  image  of  a  relation  R  under  a  function  /  by 

/  $  R    =    {  <fx,  fy>  |    <z,  y>  €  R  } 

This  can  be  read  "the  /  isomorphism  of  i?"  or  "the  isomorphic  image  under  /  of  /?."  Note  however  that 
/  $  R  is  isomorphic  to  R  only  if  /  is  defined  for  all  members  of  R,  otherwise  /  $  R  is  isomorphic  to  a 
subrelation  of  R.    Hence  we  introduce: 

Definition  2:    The  members  of  a  relation  is  the  union  of  its  domain  and  range: 

mem  R    =    dom  R  U  rng  R 

Definition  3:    The  isomorphism  /  is  defined  on  R  if  and  only  if  mem  R    C    dom  /. 

If  /  is  treated  as  a  relation,  and  composition  is  allowed  between  relations,  then  we  can  derive  an  expres- 
sion for  the  isomorphic  image  in  terms  of  composition: 

<«,  t;>  e  (/  $  R) 

•*=>  3  z,  y  \<x,  y>  €  R  /\  u  =  fx  [\  v  =  fy\ 

<^>  3  x.  y  \<x,  y>  €  R  A  <z,  u>  6  f  f\  <y,  v>  6  f] 

<=>  3  z,  y  [<u,  z>  G  f'1  A  <z,  y>  €  R  A  <y,  v>  6  /] 

■^  3  y  [<«,  y>  €  (R  •  T1)  A  <y,  t»  €  /] 


*=*  <u,v>e(f  •  R  •  r1) 

Hence  we  have 

/  $  iz  =  /  •  r  ■  /-1 

This  is  of  course  exactly  our  formula  for  the  functional  difference.  Note  however  that  /  $  h  is  denned  for 
all  /  and  /i,  but  that  it  is  a  solution  to/h  =  gf  only  if  that  equation  has  a  solution.  This  is  summarized 
in 

Theorem  4:    Let  /  be  an  isomorphism.    Then 

/  .  h   =   (/$A)  o  / 

if  and  only  if  dom  (/       h)    C    dom  /. 
Proof:   This  follows  from  Thm.  2.    o 

Corollary  4-1:  If  /  is  one-to-one  and  dom  h  C  dom  /,  then  /  $  /i  is  the  functional  difference  of  / 
with  respect  to  h. 

Proof:   Since  dom  fh    C    dom  /i    C    dom  /  we  can  apply  the  preceding  theorem.     □ 

Corollary  4-2:  If  /  is  one-to-one  and  defined  on  h,  then  /  $  h  is  functional  difference  of  /  with  respect 
to  h. 

Proof:  Since  /  is  defined  for  h,  mem  h  C  dom  /.  But  dom  h  C  mem  A,  so  dom  /i  C  dom  /  and  the 
previous  corollary  applies.     Q 

Corollary  4-3:  The  functional  difference  of  /  with  respect  to  h,  if  it  exists,  is  /  $  h,  the  /  isomor- 
phism of  h. 

Notice  again  that  these  results  apply  to-  any  relation  h;  thus  we  will  be  able  to  take  functional 
differences  with  respect  to  any  relations  (i.e.,  regardless  of  whether  they  are  one-to-one  or  even  functions). 
We  will  exploit  this  generality  in  the  later  development  of  the  calculus.  On  the  other  hand,  we  still  require 
/  to  be  one-to-one. 


Because  isomorphism  satisfies  the  difference  equation  (if  anything  does)  we  can  read  '/  $  h'  either  as 
"the  isomorphic  image  under  /  of  A,"  or  as  "the  functional  difference  of  /  with  respect  to  h."  We  call 
/  $  h  the  functional  difference  regardless  of  whether  the  existence  condition,  dom  Pi  C  dom  /,  is  satisfied. 
That  is,  the  functional  difference  exists,  even  if  there  is  no  functional  difference  equation  that  it  satisfies. 

3.    Hasse  Diagrams 

We  will  exploit  the  relation  between  isomorphic  images  and  functional  differences  so  as  to  better  under- 
stand the  latter.  In  particular  we  can  learn  a  lot  about  functional  differences  by  looking  at  their  Hasse 
diagrams. 

The  Hasse  diagram  of  a  relation  R  is  constructed  as  follows.  The  diagram  is  a  directed  graph  that  has 
a  vertex  for  every  member  of  R  (i.e.,  for  every  domain  or  range  element  of  R).  An  edge  goes  from  vertex  z 
to  vertex  y  if  and  only  if  <z,  y>  €  R. 

If  R  is  a  function  then  there  is  at  most  one  edge  leading  out  of  each  vertex  in  its  Hasse  diagram. 
Further,  if  R  is  an  isomorphism,  then  there  is  also  at  most  one  edge  leading  into  each  vertex.  We  will  be 
most  interested  in  a  restricted  class  of  isomorphisms  called  sequences,  which  are  connected  one-to-one  func- 
tions.   The  Hasse  diagram  for  a  finite  sequence  has  the  form: 


In  X-\  X 


->• -S-i 


0         il         x2  An-1         xn 

We  will  often  write  such  a  relation  in  an  abbreviated  form: 

(z0,  xl,  x2,  ■  ■  ■  ,  xn-\,  xn) 

If  R  is  an  infinite  sequence,  then  its  Hasse  graph  must  be  a  sequence  that  is  infinite  on  either  or  both  ends. 
We  will  be  most  interested  in  the  case  in  which  the  sequence  is  well  founded,  that  is,  has  an  initial  member: 

• *• — a— — *- 


x0        x\        x2 


x0  is  called  the  initial  member  [Carnap58,  MacLennan83|  of  the  sequence.    It  will  also  be  convenient  to 
write  these  relations  in  an  abbreviated  form: 

(l0,   Zj,   x2,  ) 

This  case  is  of  most  interest  to  us,  for  it  represents  a  function  h  such  that  any  z,  can  be  reached  from  z0  by 


a  finite  number  of  applications  of  h.    In  particular 


=    /»' 


This  is  exactly  the  situation  we  postulated  in  our  discussion  of  functional  differences. 

Next  we  consider  the  Hasse  diagrams  of  functional  differences.    Therefore,  suppose  that  h  is  a  finite  or 
infinite  sequence  and  that  z0  is  the  initial  member  of  h.    This  relation  can  be  diagramed: 

« *-• *-• >• > 

i0    h    ij    h    x2    h    Zj    h 


For  each  i  define  y,    =    fx,.    We  can  diagram  /: 


Xq  I]  x2  xz 


i    i   -i    i 

s/o      yi      yi      </s 


By  applying  /  to  each  member  of  h  we  get  the  isomorphic  image  f  %  h: 


i >• >* »-• — »- 

yo      y\      y-i      y? 


It  is  easy  to  see  that  this  relation  represents  the  functional  difference  of  /  with  respect  to  h.    Call  the 
diagramed  relation  g  and  observe  j/1+,    =    g  y,.    Then. 


/  [h  x,)    =    fxi+i    =    yl+,    =    g  y,    =    g  (fx,) 


Thus  f  °   h    =    g  °   /. 


Combining  the  diagrams  for  /,  g  and  h  we  have: 


Xn               Xi                Xo  X 

t >♦ *^ *•♦ 


/  = 


N'        V        V        Y 

* — >* S-* >* — ^- 

9     =     yo      yi      y2      y; 


This  diagram  makes  it  apparent  that  g    =    f  »   /i  °   /  J,  since  to  get  from  y,  to  y1  +  ]  we  go  backwards  along 
an  /  arrow,  forward  on  an  h  arrow,  and  forward  on  an  /  arrow.    Notice  however  that  if  /  is  not  defined  for 
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some  x,  then  g  will  be  isomorphic  to  a  paxt  rather  than  all  of  A.    In  fact  g  is  isomorphic  to  all  of  /  only  if  / 
is  defined  for  all  z,  (i.e.,  mem  h  C  dom  /). 

4.    Properties  of  Differences 

We  develop  a  number  of  simple,  useful  properties  of  functional  differences. 

Theorem  5:    The  functional  difference  of  the  total  identity  with  respect  to  any  function  is  that  func- 
tion: 

1$  h    =    h 

Proof:   Derive  IH    =    I  •  M"1    =    A  •  I    =    A.     □ 

Theorem  6:    The  functional  difference  of  a  function  with  respect  to  itself  is  itself  (but  restricted  to  its 
range): 


h%  h    =    h  •  I 


rng  h 


Proof:   We  derive:    h%h    =    h  °   h  °   h'1    =    h  •  I      k.     d 


This  result  is  easily  understood  from  the  diagram: 


h       =       i0    h    ij    h    z-i    h 

t *t >•- >■ 


h      o      I 


rng  A 


r,     h    i,    h     x,    h 


Corollary  6-1:    The  difference  of  a  power  of  a  function  with  respect  to  that  function  is  that  function 
(restricted  to  the  range  of  the  power): 


hn  %h    =    h  •  I 


(rng  fc») 


Proof:   Derive  hn  $  h    =    hnhh~n    hhnh-n    =    hi,       ..,.     a 

/  (  rng  fc") 


For  the  case  n  =  2  this  result  is  made  clear  by  the  diagram: 
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h       —       x0        ij        x2        Zj 


"*f ^f — ► 


/i       = 


(rng  h  ) 


y  "  y 

-^* ^ ^-* »- 


Theorem  7:    The  inverse  of  the  difference  of  one  function  with  respect  to  a  second  is  the  difference  of 
the  first  with  respect  to  the  inverse  of  the  second: 


(/$  h)-1    =    f  %h 


Proof:   For  the  equality  result  we  derive: 


(/$/,)->  =  (fhr'r1  =  (r1)-1*-1/-1  =  fh-'r1  -  /**-• 


The  theorem   is  obvious  if  we  consider  differences  as  isomorphic  images:     the  inverse  of  the  isomorphic 
image  of  a  relation  is  the  isomorphic  image  of  the  inverse  relation. 


Corollary  7-1:    If  mem  A    C    dom /,  then  (/$ /i)"1    =    f$h 


Proof:   Under  the  given  condition, 


-l 


dom  f(h  U  h  x)    C    dom  (h  U  h   l)    =    mem  h    C    dom  / 


Alternately  observe  that  the  existence  of  the  two  differences  follows  from  these  inequalities: 


dom  fh    C    dom  h    C    mem  h    C    dom  / 

dom  fh~l    C    dom  A-1    =    rng  h    C    mem  /i    C    dom  / 


Theorem   8:     The   difference   with    respect   to   a  composition   of  functions   is   the  composition   of  the 
differences  with  respect  to  each  of  the  functions: 


provided  dom  3  C  dom  /  or  rng  h  C  dom  /. 
Proof:   We  begin  with  the  right-hand  side: 
(/$<,)(/$/,)   =    (fgf-'Ufhf-1) 

=  fg(rli)hrl 

=    f(9homfh)rl 
=    /$(*Id.«/A) 

Now,  if  dom  j  C  dom  /  then  gl,iom  /    =    <7i  whereas  if  rng  h  C  dom  /  then  Idom  fh    =    &.    So  in  either  case 
gIdom  fh    =    gh  and  we  have  (/  $  g)(f  S  h)  is  /  $  g/i.     D 

This  theorem  provides  a  kind  of  chain  rule  for  evaluating  differences. 

Corollary  8-1:    The  difference  with  respect  to  the  rath  power  of  a  function  is  the  rath  power  of  the 
difference: 

/$  hn    =    (/$  h)n 

provided  dom  h  C  dom  /  or  rng  h  C  dom  /. 


Proof:   This  is  an  inductive  application  of  the  previous  theorem.     □ 


The  case  where  ra  =  2  is  obvious  from  the  diagram: 


z0    h    ij    h    i2    h    z.    h    j4    h 


We  use  a  product  notation  for  compositions: 
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n  F,   =   F,  °  F2 

1  =  1 


Fn-t  •  Fn 


Using  this  notation  we  can  express 

Corollary  8-2:    The  difference  with  respect  to  a  product  of  functions  is  the  product  of  the  differences 
with  respect  to  each  of  those  functions: 


/ 


n 

n*.- 

i  •=>  i 

=  n  (/  *  *i) 

1=1 


provided  either  the  domain  or  range  of  each  of  those  functions  is  a  subset  of  the  domain  of  /. 


Proof:   This  is  just  an  inductive  application  of  the  theorem.     □ 


Corollary  8-3:    If  z„    =    hn  x0,  then 


/*„  =  (/  $  /,)"  (/*„) 


That  is,  if  y,    =    /i,  then  yn    =    (f  $  h)n  y0. 


Proof:  This  is  an  induction  based  on 


yn  =  /(/»*™-i)  =  (/$M(K-.)  -  (/**)»„_, 


Theorem    9:      If    x„    = 


II  H, 


1=1 


/ 


x0    and     y,    =    F  i,     then     y„    = 


n  f  $  h, 

1=1 


y0,     provided     that 


dom  (F  °   i/,)    C    dom  F,  for  1  ^  i  ^  n. 


Proof:   The  notation  implies  that  HXH2     '     Hn  is  a.  function.    Expanding  the  product  we  have: 


F  x=    F 


i             \ 
n 

n 

n^ 

*0 

= 

m* 

\  .=i  j 

•=1    / 

x0   =    [FHXH2  ■  ■  •  //„_,//„)  xc 


We  know  from  the  definition  of  functional  difference  that  F/f,    =    (F  $  //,)F  so  we  can  push  the  F  to  the 
right  through  the  H,\ 
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FHXH2  •  ■  ■  Hn_xHn   =  (F  $  HX)FH2  ■  ■     Hn.xHn 

=  (F$^)(F$^2)F   •••   Hn_tHn 

=  (F$#,)(F$  ff2)    •  •  •   [F$Hn)F 
Thus  we  have 


F  •   n  fll r   - 
1=1 


Hence, 


n 

■ 

n 

F$  #, 

1=1 

, 

yn  =  F  xn  = 


n  f  $  #, 

1=1 


(f*o)    = 


YlF%Ht 
i  =  i 


yo 


which  proves  the  theorem.     □ 


This  theorem  tells  us  how  to  use  functional  differences  to  get  from  fx0  to  fxn,  provided  xn  is  reachable  from 
x0.    It  is  a  functional  difference  analogue  of  Taylor's  Theorem. 

Let  '(/  $]'  denote  a  presection  [ Wile73]  of  the  isomorphism  operator;  that  is, 

[/  $]  h    =    f%h 

Since  [/  $]  leaves  h  unspecified,  we  call  \f  $)  the  indefinite  functional  difference  of  /. 

Theorem    10:     The    indefinite    difference    of   the    composition    is    the    composition    of   the    indefinite 
differences: 

[(/•  </)$]  -  l/s]  •  Ml 

That  is,  (/  °    g)  $  h    =    /  $  (g  $  h). 

Proof:   The  derivation  is  direct: 

fgth    =    [fg)h(fg)-1 
=  fghg-'r1 
=  f(ghg Mr' 

=  /(?$M/_1 
=  /$($$/») 
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The  theorem  is  obvious  from  its  diagram: 


ft  —  In  II  12 

— *f *f *- 


«/o     y\      y* 


f     = 


L^i 


-*• — *- 


Zq  Zj  z2 


The  preceding  theorem  is  a  kind  of  chain  rule  for  functional  differences.    It  leads  to 

Corollary    10-1:     The    indefinite    difference    of   the    nth    power   is    the    nth    power   of   the   indefinite 
difference: 


[/"$]    =    |/$]n 


That  is,  /"  $  h    =    [/  %\nh. 


Proof:   This  is  just  the  inductive  extension  of  the  previous  theorem.     □ 


Corollary  10-2:    The  indefinite  difference  of  the  product  is  the  product  of  the  indefinite  differences: 


TLfi 


1=1 


That  is, 


Tlfi 

1=] 


/ 


a  = 


n  [/.  •] 
1=1 


Proof:   This  also  follows  inductively  from  the  theorem.     □ 


5.    Examples  of  Differences 

In  this  section  we  give  several  examples  of  functional  differences.    We  begin  with  numerical  functions, 
since  they  are  most  familiar.    Let  a  be  the  successor  function: 

a  =   (0,  1,  2,   •  •  • ) 

Using  the  presection  and  postsection  notations  ([a  +]  i  =  a  +  i,  [—  6]  x  —  z  —  b,  etc.)    we  have  the  fol- 
lowing differences  (where  we  let  '?'  represent  exponentiation,  a  f  n    =    an): 

[a  +]  $  a  =  a 

\a  x]  $  a  =  \a  +] 

\a  Tl  $  a  =  [a  x] 

[a  -j  $  a  =  a-1 

[—  a]  $  a  =  a 

The  first  of  these  equations  follows  from  Corollary  6-1  and  the  observation  that  [a  +]    =    aa .    The  next 
two  equations  follow  from  the  definition  and  theorem  below,  which  generalizes  Corollary  6-1. 

Definition  4:     We  write  '(power0  /)  n'  for  the   n      power  of  function   /  applied  to  initial  value  a: 
(power0  /)  n    =    /"  a.    This  is  defined  recursively: 

(powera  /)  0    =    a 
(powera  /)  (n  +  1)    =    /  [(power0  /)  n],    for  n^O 

We  call  powera  /  'the  power  from  a  of  /'. 

Theorem  11:    The  difference  of  the  power  (from  a)  of  /  with  respect  to  successor  is  /: 

(powera  /)  $  a    =    f 

Proof:   This  follows  directly  from  the  definition  of 'power': 

(powera  /)  (a  n)    =    /  |(powera  /)  n\ 

Therefore,  (powera  /)  °  o    =    /  °   (power0  /).     o 

Now  observe  that 
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[a  +}    =    power0  a 
[ox]    =    power0  [a  +} 
[a|]    =    power,  [ox] 


[a  -]    =    powera  a  ' 


The  differences  of  these  functions  then  follow  from  the  theorem. 


6.    Recursive  Definitions 


Consider  the  following  equations,  which  define  the  length  function  on  LISP-like  lists: 

length  nil    =    0 

length  (z  &  y)    =    1  +  length  y 

(Here  'z  &  y'  denotes  the  result  of  prefixing  x  on  the  list  y  —  the  LISP  'cons'  operation.)    The  second  equa- 
tion is  a  functional  difference  equation,  as  can  be  seen  by  writing  it  in  the  form: 

length  •  [x  &]    =    a  °  length 

Hence  it  is  easy  to  see  that  the  change  in  length  with  respect  to  prefixing  is  the  successor: 

length  $  [i  &]    =    a. 

On  the  other  hand,  if  we  were  to  define  length  recursively,  we  would  write  something  like  this: 

I  0,  if  L  =  nil 

length  L    =  |  j  +  ]ength  (rest  L)        if  L  #  ni, 

This  corresponds  to  the  equations 

length  nil    =    0 

length  L    =    1  +  length  (rest  L),  for  L  ^  nil 

The  second  equation  here  is  also  a  sort  of  difference  equation,  but  it  does  not  fit  our  earlier  form.    Written 
in  terms  of  compositions  it  is: 

length  »  1N    =    a  °  length  °  rest 

where  we  have  composed  length  with  1N  to  restrict  its  domain  to  nonnull  lists  (taking  N  to  be  the  set  of 
nonnull  lists). 
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What  is  the  relationship  between  the  two  difference  equations  satisfied  by  length?  Consider  the  first 
difference  equation: 

length  °   [z  &]    =    a  °  length 

Compose  with  the  inverse  of  (z  &]  on  both  sides: 

length  •   \x  &]  •   \x  <fej_1    =    a  •  length  •   \x  &]_1 

Now  [z  &]  °   \x  &]_1  is  the  identity  restricted  to  the  range  of  [z  &],  which  in  turn  is  the  set  of  lists  begin- 
ning with  x.    Hence,  if  N%  is  the  set  of  nonnull  lists  beginning  with  z,  then 

length  •>  IN     =    a  °   length  °   [z  &]_1 

This  looks  almost  like  our  second  difference  equation: 

length  °  IN    =    a  °  length  •  rest 

We  can  see  their  relationship  as  follows. 

The  meaning  of  [z  &J  is  to  put  z  on  the  front  of  its  argument.  Hence,  the  meaning  of  [z  &]-1  is  to  take 
z  off  the  front  of  its  argument.  On  the  other  hand  'rest'  takes  the  first  thing  off  the  front  of  its  argument 
no  matter  what  it  is.  Hence  [z  &]_1  is  like  'rest'  except  that  it's  defined  only  on  lists  whose  first  element  is 
z.    That  is,  [z  &j_1  is  a  proper  subfunction  of  'rest',  [z  &]_1    C    rest. 

Now  we  make  two  simple  observations.  First,  the  set  of  all  nonnull  lists  is  the  union,  for  all  z,  of  the 
nonnull  lists  that  begin  with  z: 

N   =    UN, 

z 

Second,  the  'rest'  function,  which  deletes  the  first  element  of  a  list  no  matter  what  it  is,  is  the  union  of  all 
the  functions  \x  &]-\  which  delete  z  from  the  front  of  a  list: 


rest    =    I^J  [z  & 


J 


It  is  now  easy  to  show  the  two  difference  equations  are  equivalent. 
Theorem  12:    Suppose  that 

length  •   Ijy     =    a  °   length  °   [z  &]-1 
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is  true  for  all  z.    Then 

length  °  IN    =    a  "  length  •  rest 
The  converse  also  holds. 

Proof:   To  prove  the  first  implies  the  second  we  have: 
length  ■  IN    =    length  ■  ^J  1^ 

=    U  (length  •  lNt) 

=    (J  [a  °  length  •   \x  &]""1) 

=    o  °   length  °   [_j  \x  &J-1 

z 

=    a  o  length  •  rest 

To  prove  the  second  implies  the  first  we  restrict  both  sides  to  Nz: 

length  •  1N  •  1N     =    o  «  length  °  rest  •  IN 
Observing  that  rest  •  1N     —    [x  &.\~l: 

length  o   1^     =    o  °   length  ■   [x  &]-1 


7.    Definition  of  Integral 

In  this  section  we  consider  a  functional  integration  operation  that  is  inverse  to  the  functional  difference. 
That  is,  given  isomorphic  functions  g  and  h  we  want  to  find  an  /  that  satisfies  the  functional  difference 
equation 

g    =    /  $  h 

Since  this  equation  states  that  g  is  the  isomorphic  image  under  /  of  h,  our  goal  can  be  viewed  as  finding  an 
isomorphism  between  g  and  h. 

In  general  there  may  be  many  isomorphisms  between  two  relations.  Since  this  implies  that  the  solution 
to  a  functional  difference  equation   is  often   underdetermined  by   the  equation,   to  determine  a  particular 
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solution  it's  necessary  to  specify  a  boundary  function  b  contained  in  the  solution.    Thus  the  solution  to  the 
equation  is  required  to  be  an  extension  of  the  boundary  function  (i.e.,  b  C  /). 

As  we  did  for  functional  differences,  here  also  we  want  to  permit  the  case  where  g  is  isomorphic  to  a 
part  of  /;  that  is,  the  case  in  which  /  is  not  defined  for  some  members  of  h.    This  leads  us  to: 

Definition  5:  Let  arbitrary  relations  g,  h  and  6  be  given.  If  there  is  a  minimum  isomorphism  /,  with 
b  C  /,  satisfying  the  equation 

/•  h   =   g-  f 

then  we  call  /  the  definite  functional  integral  with  respect  to  h,  from  6,  of  g.    We  write  /: 

h  $6  g 

This  is  read  "the  h  integral  from  6  of  g." 

Theorem  13:    If  the  definite  functional  integral  exists,  then  it  satisfies  the  equation: 

(A  $»<)    '  h    =    ,  •  \h$bg) 
Proof:   Follows  immediately  from  definition.    D 

Next  we  explore  the  conditions  under  which  functional  integrals  exist. 

Lemma  13-1:  R  and  S  are  isomorphic  relations  if  and  only  if  there  exists  a  one-to-one  function  <f>  such 
that  S    =    (j>  $  R  and  mem  R    =    dom  <f>  and  mem  S    =    rng  <f>. 

Proof:   This  follows  easily  from  the  definition  of  isomorphic  relations  in  [Carnap58j.     n 

The  preceding  lemma  says  that  two  relations  are  isomorphic  if  there  is  a  one-to-one  function  (isomor- 
phism) between  them  that  preserves  all  the  structure  of  both.  Following  (Carnap58]  we  call  such  a  func- 
tion a  correlator  between  the  relations.  In  the  following  definition  we  give  a  name  to  the  case  in  which  the 
correlator  does  not  preserve  all  the  structure  of  one  of  the  relations. 

Theorem  14:  If  g  and  h  are  isomorphic  relations,  and  6  is  a  subset  of  exactly  one  isomorphism 
between  g  and  h,  then  h  <J) b  g  exists. 
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Proof:  We  know  (by  hypothesis)  that  there  is  a  unique  /  such  that  6  C  /  and  /  is  an  isomorphism 
between  g  and  h.  Note  that  since  /  is  a  correlator  between  g  and  h,  g  =  f  $  h  and  mem  h  =  dom  /. 
Hence  we  can  apply  Cor.  4.1  and  conclude  that  /  $  h  satisfies  the  difference  equation  fh  =  gf.  This  /  is 
minimal,  since  eliminating  any  element  of  /  would  result  in  /  not  being  defined  for  all  members  of  h  (and 

hence  not  an  isomorphism  between  g  and  h).    Hence  /  is  the  functional  integral  h  (J)6  g.     □ 

8.    Examples  of  Integrals 

We  can  perform  a  number  of  functional  integrations  based  an  previously  established  functional 
differences.    First  note 

Theorem  15:    The  power  operator  satisfies  the  difference  equation: 

(power0  /).»-/•   (powera  /) 

Proof:  We  have  already  shown  (Theorem  11)  that  (power0  /)  $  a  =  /,  so  it  remains  to  show  that  the 
difference  equation  has  a  solution.    But  we  know  a  solution  exists  if  and  only  if 

dom  (powera  f)a   C    dom  (powera  /) 

But  since  dom  a    =    dom  (powera  /)  the  above  condition  holds.     □ 

Corollary  15-1:    The  a  integral  from  (0,  a)  of  /  is  the  power  from  a  of  /: 

°  $(o,  a)  /    =    powera  / 

Proof:  Since  (powera  /)  0  =  a  we  know  that  the  boundary  relation  (0,  a)  C  powera  /.  The  result 
follows  because,  by  the  preceding  theorem,  the  power  operator  satisfies  the  difference  equation  (and  it  is 
clear  that  it's  the  only  isomorphism  to  do  so),     a 

Corollary  15-2:    We  have  the  following  functional  integrals: 

"   $(0,  a)   O  \a    +1 

a   ^(0,0)    la    +1  =  la    Xi 

a  $(o,i)  la   X]  =         [«  I] 
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°   3>(0,  a)  °    1  =  |«   -] 

a  $(o, -a)  <?  h  «] 

Proof:   Immediate  application  of  preceding  corollary  and  definitions  of  the  integrands.     Q 

9.    Computing  Integrals  of  Sequences 

Consider  the  difference  equation  /  •  h  =  g  °  f  and  suppose  that  we  are  given  g  and  h  and  want  to 
determine  /.  We  begin  by  investigating  a  restricted  class  of  equations:  those  in  which  both  g  and  h  are 
well-founded  sequences.  So  further  suppose  that  h  is  the  sequence  (x0,  x1,  ■  •  •  )  and  g  is  the  sequence 
(j/o>  ^i>  '  '  '  )•  Thus  z,  =  h'  x0  and  y,  =  g'  y0.  Finally  suppose  that  the  solution  is  required  to  extend 
the  boundary  function  b    =    (z0,  y0)  that  maps  i0  into  y0.2  This  situation  can  be  diagramed: 

1  >  * V»- *- 


V        V v 


Our  goal  is  to  find  an  isomorphism  /  connecting  each  x,  with  the  corresponding  y,,  that  is,  y,    =    fx,.    We 
will  construct  /  inductively. 

Referring  to  the  above  diagram  it  can  be  seen  that  we  can  get  from  xQ  to  y0  by  following  edge  b.  We 
can  get  from  xx  to  y,  by  following  h~l  (i.e.,  h  backward),  then  6,  then  h.  Similarly,  to  get  from  i2  to  y2, 
we  follow  h~l  twice,  then  b,  then  h  twice.  Thus  /  can  be  expressed  as  the  infinite  union  of  the  paths 
(i,,  y,),  which  can  be  expressed  in  terms  of  h     ,  6  and  h. 

f    =    (*o.  yo)  U  (i,,  y,)  U  (z2,  y2)  u  (is,  ys)  U    •  ■  ■ 

=    6  U  (g  •   6  •  /T1)  u  (g2  »   6  •  A"2)  U  (ff3  •  /j"5)  U    •  •  • 

Hence, 

00 

/    =    6  U  gbh'1  u  g26/T2  U  ys6/r3  U    •  •  •     =    6  U  \J  g,bh~i 

1=1 


2.    Actually,  in  this  case  there  is  only  one  possible  isomorphism  between  the  relations  g  and  h,  so  the  specification  of  the  boundary 
function  is  redundant.    However,  we  are  trying  to  develop  a  general  method. 
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We  would  like  a  finite  representation  for  /.    Therefore  compose  on  the  left  with  g  and  the  right  with  h   l  to 
get: 

gfh'1    =    gbh'1  U  g2bh~2  U  gHh'*  U    •  •  ■     =    {J  g'bh- 

i=l 

This  is  the  original  equation  except  for  the  b  term,  so  it  is  easy  to  see 

/    =    b  U  gfh-1 

Thus  we  have  a  recursive  definition  of  /,  the  solution  to  the  functional  difference  equation.    Our  next  goal 
will  be  to  obtain  a  finite,  nonrecursive  expression  for  the  solution. 

Define  the  functional  product  f  \\  g  between  two  functions: 

(/  II  9)  <x,  y>    =    <f  x,  g  y> 

Thus,  if  /:  D  ->  R  and  g:  D'  -  R' ,  then 

(f\\g):(D  x  D')-(R  x  R') 

Now  it  is  easy  to  see  that 

<zu  2/i>    =    (h  II  9)  <*o>  S/o> 

<*2>  V2>    -    ih  II  9)  <*v  Vi>    =    (h  ||  gf  <x0,  y0> 

<*s,  ys>   -   (A  II  g)  <x2,  y2>   =   {h  II  g)3  <x0,  y0> 

<z,,  y,>    =    (/i  ||  ?)'  <z0)  y0> 

Hence, 

/   =    {  <*o>  yo>.   (^  II  g)  <xor  yo>>   (A  II  g)2  <x0,  y0>,   (/i  ||  ^)s  <i0,  y0>,     •  •  •     } 

It  can  be  seen  that  /  results  from  applying  all  the  functions  (h  ||  y)°,  (h  \\  g)1,  (h  \\  g)2,    •  •  •    to  the  initial 
pair  <x0,  y0>.    We  will  show  that  this  is  the  image  of  the  relation  (i0,  y0)  under  the  transitive  closure: 

(h  II  g)'   =    (h  \\g)°u(h  \\gyu(h  \\g)2u      ■■ 

Therefore  define  the  image  function: 

img/5    =    {  y  \  3x  e  S  \<z,  y>  6  /]  } 
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We  begin  by  proving 

Lemma  15-1:    For  any  relations  /  and  g  and  any  set  S, 

img  /  S   U  img  g  S   =    img  (/  U  g)  S. 

3  i  €  5  [<z,  y>£/Uj] 

3  i  €  5  [<z,  y>  e  /  V  <x,  y>  G  y] 

3  x  6  5  [<z,  y>  e  /]  V  3  i  €  5  [<z,  y>  €  g\ 

y  G  img  /  5    V    y  €  img  y  5 

y  e  (img  /  5    U    img  g  5) 


Proo/: 


y  £  img  (/  U  g)  S 


Note  that  this  lemma  applies  when  /  and  g  are  functions,  although  in  that  case  /  U  g  will  not  be  a 
function  unless  /  and  g  have  disjoint  domains. 


We  already  know  that 


/    =    (*o>  yo)  U  (z„  y,)  U  (z2,  y2)  U 


Now  observe  that 


(*,-,  y.)  =  {<*.,  y.>} 

=    {(h  i|  y)'  <i0,  y0>} 

=    img  (A  ||  g)'  {<x0,  y0>} 

=    img  (h  ||  g)'  (i0,  y0) 

Hence,  taking  b    =    (i0,  y0), 

/    =    [img  (A  ||  g)°  6]  U  [img  (h  ||  g)1  6]  U  [img  (h  ||  g)2  6]  U    ■  ■  ■ 
which  by  the  lemma  is5 

/    =    img  \(h  ||  g)°  U  (A  ||  g)1  U  (h  ||  g)2  U    ■  •  ■  J  ft  img 


(J  [img  (A  ||  g)'  6| 

i  =  0 


u  (h  li  *)•' 

1  =  0 


3.     Actually,  by  a  transfinite  extension  of  the  lemma. 
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But  the  expression  in  brackets  is  just  the  transitive  closure  of  (h  ||  g),  so  we  have 

/    =    img  (A  ||  g)'  b 

as  a  solution  to  the  functional  difference  equation 

/•  h   =   g-  f 

This  result  is  summarized  in 

Theorem  16:  If  h  and  g  are  well-founded  sequences  and  b  =  (x0,  j/0),  where  x0  and  y0  are  the  initial 
members  of  h  and  g,  respectively,  then  the  definite  functional  integral  with  respect  to  A  of  g,  generated 
from  boundary  isomorphism  b,  is 

A  $4  g   =    img  (A  \\g)'  b 
Proof:  The  proof  is  clear  from  the  derivation,    o 

Therefore  we  introduce 

Definition  6:  If  g  and  h  are  well-founded  sequences  then  the  indefinite  functional  integral  with  respect 
to  A  of  g  is: 

A  <j>  g    =    img  (A  ||  g)' 

This  is  read  "the  A  integral  of  y." 

Our  next  task  must  be  to  prove  that  this  solution  satisfies  the  difference  equation. 

Theorem  17:  If  g  and  h  are  well-founded  sequences,  then  the  definite  functional  integral  satisfies  the 
equation 

[h$k  jj     •   A    =     g  >  [h  $6  jj 
Proof:   As  shown  in  the  proof  of  Lemma  15-1, 

A  3>*  3    =    (*o.  Jto)  u  (*u  yi)  u  (*2>  »2)  u 
Hence  the  left-hand  side  of  the  difference  equation  is: 

{h  $4  g)  •   A    =    [(x0,  y0)  U  (xj,  y,)  U  (x2,  y2)  U    ■  ■  •  ]  •   h 


=  (*oi  vi)  u  (*n  yi)  u  (z2>  y$)  u 

The  last  equation  follows  from  z,+1    =    hxt.    Now  we  turn  to  the  right-hand  side  of  the  equation: 

g  -   (h  $6  g)    =    g  •    [(z0,  y0)  U  (i„  y,)  U  (x2>  y2)  U    ■  •  •  ] 
=    (*oi  »i)  u  (xv  Vi)  u  (z2.  ys)  u 
The  last  equation  follows  from  y,+1    =    yy,.    The  identity  of  these  results  proves  the  theorem,     o 
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